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DESCRIPTION 

Attorney Docket No. 38195.68 

A SIGN LANGUAGE INTERPRETATION SYSTEM AND A SIGN LANGUAGE 

INTERPRETATION METHOD- 

TECHNIC A bBACKGROUND OF THE INVENTION 
1 - Field of the Invention 

The present invention relates to a sign language 
interpretation system and a sign language interpretation 
method which allow, by using a videophone, a deaf-mute person 
capable of using sign language to have a conversation with a 
non-deaf -mute person incapable of using sign language, and -ift 
particular m ore particularly, the present invention relates to 
a sign language interpretation system and a sign language 
interpretation method which provide a deaf-mute person with 
administration services over a videophone even in caoc when a 
person capable of using sign language is not rGoidcnt present 
in an administrative body_j_ such as a public office, a hospital 
and a police station. 

DaGkground 2. Description of the Related Art 

A deaf-mute person who is hearing and speaking impaired 
communicates with a non-deaf -mute person by means of writing 
or sign language. Fluent conversation is difficult by way of 
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communications in writing. Moreover, a very small number of 
non-deaf -mute persons can use sign language. These problems 
present a high s ubst ant ial barrier in the social life of a 
deaf-mute person. 

While a conversation using sign language over a 
videophone is available at a practicaliy level with the 
advancement of communications technologies, a deaf-mute 
person can have a conversation over vidooconf crcncG videophone 
with a non-deaf -mute person who cannot use sign language only 
when a sign language interpreter joins the conversation. 

In particular, in an administrative body such as a public 
office, a hospital and a police station, it is difficult to 
assign a person capable of using sign language. Thus, in order 
to provide a deaf-mute person with services from such an 
administrative body in an emergency, it is urgently 



of a mute-deaf person and an administrative body as well as 
establish a sign language interpretation system which allows 
a deaf-mute person to have a conversation with a non-deaf -mute 
person over a videophone via sign language interpretation. 

In order for a non-deaf -mute person and a deaf-mute 
person to have a conversation over a videophone, it is necessary 
to interconnect a videophone terminal used by deaf-mute persons, 
a videophone terminal used by non-deaf -mute persons and a 
videophone terminal used by sign language interpreters. In 




^ necessary to arrange videophone terminals at the home 
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the conventional art, it has been necessary to establish a 
videoconf erence among the videophone terminals for deaf-mute 
persons, non-deaf -mute persons and sign language interpreters 
by using a Multipoint Connection Unit (MCU) which interconnects 
videophone terminals i n at least three locations . 

However, in order to establish a videoconf erence by using 
an MCU, it io ncccGsary that a deaf-mute person, a non-deaf -mute 
person and a sign language interpreter must hold prior 
conoultation c onsultati ons with one another and reserve the MCU 
It is practicQlly — difficult for a deaf-mute person and a 
non-deaf -mute person to hold prior consultation. 

In an emergency, reservation of the MCU is impossible. 
The MCU which aGoumoo rcacrvation io practically unavailable. 
MCUs which take reservations are scarcely available. 

Thu3 , — a main object 

SUMMARY OF THE INVENTION 

To overcome the problems described above, preferred 

embodiments of the present invention ±s — provide a sign 
language interpretation system and a sign language 
interpretation method which are available even in an emergency 
without prior consultation between a deaf-mute person, a 
non-deaf -mute person and a sign language interpreter and 
reservation of the MCU. 

DiscloGuro A preferred embodiment of the Invention 
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?*5^£re_sent invention doGcribcd in claim 1 io a provides 

a_sign language interpretation system which interconnects a 
videophone terminal for deaf-mute persons used by a deaf-mute 
person capable of using sign language, a videophone terminal 
for non-deaf -mute persons used by a non-deaf -mute person 
incapable of using sign language, and a videophone terminal 
for the sign language intorprotor interpreters used by the a 
sign language interpreter in order to provide sign language 
interpretation in a conversation between a deaf-mute person 
and a non-deaf-mute person over a videophone-? — charQctcrizcd 
4rFt — that — fehe — The sign language interpretation system 
comprisGG — connection — means — equipped — with — a — sign — language 
intGrprctcr registration table where the terminal number of 
•trhe — vidcophonc inc ludes communications means individually 
equipped with a line interface for deaf-mute persons to which 
a deaf-mute person terminal is to be connected, a line interface 
for non-deaf -mute persons to which a non-deaf -mute person 
terminal is to be connected, and a line interface for sign 
language interpreters -ars — regiGtercd , — tfee — connection — moans 
including a function to accept a call from the videophone t^ 
which a sign language interpreter terminal #ei^ — deaf mute 
peroono or the videophone terminal for non deaf mute persons, 
a function to prompt a calling videophone terminal for v i yhich 
the call is accepted to enter the terminal number of the called 
terminal, a function to extract the terminal number of a sign 
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language — interpreter — from — fetee — sign — language — interpreter 
registration table, a function to call the videophone terminal 
for sign language interpreters by using the extracted terminal 
number of the oign language interpreter, and a function to call 
the called videophone terminal by using the acquired called 
terminal number and 

communications means including b e connected, the 

communications means includes a function to simultaneously 
perform: a function to synthesize at least a video from the 
videophone terminal line interface for non-deaf -mute persons 
and a video from the vidcophonQ terminal line interface for 
sign language interpreters and transmit the resulting video 
to the videophone terminal line interface for deaf-mute persons , 
a function to transmit at least a video from the videophone 
terminal line interface for deaf-mute persons and a voice an 
audio from the videophone — terminal line interface for sign 

language interpreters to the videophone tcrminal line 

interface for non-deaf -mute persons^ and a function to transmit 
at least a video from the videophone tcrminal line interface 
for deaf-mute persons and a — voice — from — feh^ — videophone 
terminal an audio from the line interface for non-deaf -mute 
persons to the videophone tcrminal line interface for sign 
language interpreters; and connection means equipped with a 
sign language interpreter registration table in which the 
terminal number of a sign language interpreter is registered, 
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the connection means including: a function to accept a call 
to the line interface for deaf-mute persons or the line 
interface for non-deaf -mute persons and connect the calling 
terminal, a function to prompt the calling terminal to enter 
the terminal number of the called terminals, a function to 
extract the terminal number of a sign language interpreter from 
the sign language interpreter registration table, a function 
to call and connect the sign language interpreter terminal by 
using the extracted terminal number of the sign language 
interpreter from the line interface for sign language 
interpreters , and a function to call and connect the called 
terminal by using the acquired called terminal number, from 
the line interface for the non-deaf -mute person terminal in 
case the calling terminal is connected to the line interface 
for deaf-mute persons, or from the line interface for the 
deaf-mute person terminal in case the calling terminal is 
connected to the line interface for non-deaf -mute persons . 

With this configuration, upon a call from a terminal for 
deaf-mute persons or a terminal for non-deaf -mute persons, the 
target terminal and the terminal for sign language interpreters 
are automatically connected^ and a video and a voice required 
for sign language interpretation are transmitted, thereby a 
conversation over a videophone via sign language 
interpretation can be provided without the deaf-mute person, 
non-deaf-mute person and sign language interpreter holding 
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prior consultation. — 

Ao g function to extract and call Since the terminal 

number of a sign language interpreter registered in a sign 
language interpreter registration table is included, a sign 
language interpreter can prcoont — provide a sign language 
interpretation anywhere he/she may be, as long as he/she can 
be called, thereby a flexible and efficient sign language 
interpretation system can be provided. 

The invention dcGcribcd in claim 2 is ln the sign language 
interpretation system according to claim 1 , — charactcriEcd in 
t-h^ ^the preferred embodiment, selection information for 
selecting a sign language interpreter is preferably registered 
in the sign language interpreter registration table_j_ and that 

the connection mcang means preferably includes a function 

to acquire the conditions for selecting a sign language 
interpreter from the calling videophone terminal and a function 
to extract the terminal number of a sign language interpreter 
who satisfies the extracted selection conditions from the sign 
language interpreter registration table. 

With this configuration, a sign language interpreter who 
satisfies the object of the conditions for a conversation over 
a videophone between a deaf-mute person and a non-deaf -mute 
person from among the sign language interpreters registered 
in the sign language interpreter registration table can be 
selected. 
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The invention dcGcribcd in claim 3 — i-& In the 

sign language interpretation system according to claim 1 — 

■2-7 charactcrigcd ift that the preferred embodiment; an 

availability flag to indicate whether a sign language 
interpreter is available is preferably registered in the sign 
language interpreter registration table and that — the 
connection means preferably includes a function to extract the 
terminal number of an available sign language interpreter by 
referencing the availability flags in the sign language 
interpreter registration table. 

With this configuration, available sign language 
interpret or interpreters are automatically selected for 
calling by registering whether a sign language interpreter is 
available in the sign language interpreter registration table. 
This invention eliminates useless calling and provides a more 
flexible and efficient sign language interpretation system. 

The invention dcGcribcd in claim 4 io ln the sign language 
interpretation system according to any one — of the claims — V 
through 3, charaeterigod in that the preferred embodiment; the 
connection means preferably includes a function to generate 
a— text message to be messages to be respectively transmitted 

to each the terminalo deaf -mute person terminal , 

non-deaf -mute person terminal and that 

sign language interpreter terminal , the communications 

means preferably includes a function to transmit s ynthe size 
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^tfee the respective messages generated text moGsago to each of 
— torminalG onto videos to be transmitted to the line 
interface for deaf-mute persons, the line interface for 
non-deaf -mute persons and the line interface for sign language 
interpreters , respect i vely . 

With this configuration, a text message which prompts 
each terminal to enter necessary information when connecting 
a terminal for deaf-mute persons, a terminal for non-deaf -mute 
persons and a terminal for sign language interpreters can be 
transmitted. 

The invention dcQcribcd in claim 5 io ln the sign language 
interpretation system according to claim 4 , — charactcrigGd in 
%fe^ ^the preferred embodiment , the connection means preferably 
includes a function to generate a voice message to be 
transmitted to the terminal for non -deaf-mute persons^ and that 

the communications means preferably includes a function 

to transmit synthesize the generated voice message onto an audio 
to be transmitted to the videophone tcrminal line interface for 
non-deaf -mute persons . _ 

With this configuration, a voice message which prompts 
a terminal for non-deaf -mute persons to enter necessary 
information when connecting a terminal for deaf-mute persons, 
a terminal for non-deaf -mute persons and a terminal for sign 
language interpreters can be transmitted, thereby enabling 
visually impaired persons to have a videophone conversation 
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with deaf-mute persons via the sign language interpreter with 
the use of the terminal for non-deaf -mute persons. 

The invention dcGcribcd in claim 6 io the sign language 
interpretation system according to any one of claimo 1 through 
5, charactcrigGd in that the preferred embodiment is preferably 
equipped with a term registration table for registering a term 
used during a videophone conversation, and the connection means 
preferably includes a function to rcgiotcr a term used during 
g conversation as instructed dete ct a push on a dial pad at a 
terminal by way of an audio from each of the terminals and a 
function to extract the line interface for deaf-mute persons 
or the rcgiotorcd tcr m line interface for non-deaf -mute persons 
or the line interface for sign language interpreters and 
generate a telop as instructed from each of the tcrminalo to 
register a term corresponding to the number of the dial pad 
detected in the term registrat ion table and that 

the communications means includes a function to transmit 

the generated telop to cach detect a push on a dial pad at a 
terminal by way of an audio from the line interface for 
deaf-mute persons or the line interface for non-deaf -mute 
persons or the line interface for sign language interpreters 
during a videophone conversation and extract a term specified 
by the term registration table in association with the number 
of the terminals dial pad detected to generate a telop, and a 
function to synthesize the generated telop onto a video to be 
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transmitted to at least one of the line interface for deaf-mute 



persons, the line interface for non-deaf -mute persons and the 
line interface for sign language interpreters . 

With this configuration, a term hard to represent through 
sign language interpretation is displayed as a telop on the 
screen of each terminal by previously registering the term, 
which provides a quicker and more accurate videophone 
conversation . 

The invention dcGcribod in claim 7 is ln the sign language 
interpretation system according to any one of claims 1 through 

Gharactcrizcd — ±¥i — ^4^^ the preferred embodiment , the 

communications means preferably includes a function to 
transmit a video obtained by synthesizing one of a video from 
the videophone — terminal line interface for non-deaf -mute 
persons or the videophone — terminal and a video from the line 
interface for sign language interpreters as a main window and 
the other video as a sub window to the videophone terminal line 
interface for deaf-mute persons. 

With this configuration, a video of a non-deaf -mute 
person and a video of a sign language interpreter are displayed 
simultaneously on the screen of the videophone terminal for 
deaf-mute persons in a Picture- in-Picture representation, 
thereby the deaf-mute person can understand the sign language 
of the sign language interpreter while watching the face of 
the non-deaf -mute person. 

1 1 



The invention doGcribod in claim 8 io ln the sign language 
interpretation system according to any one of claimG 1 through 

7-; charactGrizGd — ±n — that the preferred embodiment, the 

communications means preferably includes a function to 
transmit a video obtained by synthesizing a video from the 
videophone tcrminal line interface for non deaf-mute persons 
as a main window and a video from the videophone tcrminal line 
interface for sign language interpreters as a main sub window 
to the videophone tcrminal line interface for non-deaf -mute 
persons . 

With this configuration, a video of a deaf-mute person 
and a video of a sign language interpreter are displayed 
simultaneously on the screen of the videophone terminal for 
non-deaf -mute persons in a Picture-in-Picture fashion, 
thereby the non-deaf -mute person can check the facial 
expression of the sign language interpreter while watching the 
face expression of the deaf-mute person, which facilitates 
understanding of a voice interpreted by the sign language 
interpreter. 

The invention described in claim 9 is ln the sign language 
interpretation system according to any one of claims 1 through 

charaeteriged — — fe4^e^ the preferred embodiment, the 

communications means preferably include s a function to 
transmit a video obtained by synthesizing a video from the 
videophone tcrminal line interface for deaf-mute persons and 
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a video from the videophone — terminal line interface for 

non-deaf -mute persons to the videophone tcrminal line 

interface for sign language interpreters. 

With this configuration, a video of a deaf-mute person 
and a video of a non-deaf -mute person are displayed 
simultaneously on the screen of the videophone terminal for 
sign language interpreters in a Picture- in-Picture 
representation, thereby the sign language interpreter can 
check the facial expression of the non-deaf -mute person while 
understanding the sign language of the deaf-mute person, which 
facilitates understanding of the voice of the non-deaf -mute 
person. 

The invention dcocribcd in claim 1 0 is In the sign 

language interpretation system according to the preferred 
embodiment, the communications means preferably includes a 
function to detect a push on a dial pad at a terminal during 
a videophone conversation by way of an audio from the line 
interface for deaf-mute persons or the line interface for 
non-deaf -mute persons or the line interface for sign language 
interpreters and change a method for synthesizing a video 
and/or an audio to be transmitted to the line interface in 
association with the number of the dial pad detected. 

Another preferred embodiment of the present invention 

provides a method for providing sign language interpretation 
in a conversation between a deaf-mute person and a 
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non-deaf -mute person over a videophone, the method 
interconnecting a videophone terminal for deaf-mute persons 
used by a deaf-mute person capable of using sign language, a 
videophone terminal for non-deaf -mute persons used by a 
non-deaf -mute person incapable of using sign language, and a 
videophone terminal for 'ferhea sign language interpreter used 
by the sign language interpreter, charactGriacd in that a sign 
language — intcrprctor rcgiotration table whore the — terminal 
number of the vidoophone the method individually equipped with 
a line interface for deaf-mute persons to which a deaf-mute 
person terminal for 3ign language intGrprctcro is rcgiatcrcd, 
-fefee — method — comprioing — stcpo — — accepting — a — call — from — 
vidoophonc — is to be connected, a line interface for 
non-deaf -mute persons to which a non-deaf -mute person terminal 
for deaf muto persons or the vidoophonc is to be connected, 
and a line interface for sign language interpreters to which 
a sign language interpreter terminal — non deaf mute 
per sons ; — acquiring the terminal number of a called terminal 
from the calling videophone terminal — for which the call is 
accepted; — extracting the terminal number of a sign language 
interpreter from the sign language interpreter registration 
table; — calling — t^^e — videophone — terminal — #0*= — sign — language 
intGrprctcro by using the extracted terminal number of the sign 
language interpreter; calling the called videophone terminal 
by using the acquired — called terminal number; 
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to be connected. The method includes a step of 

simultaneously performing steps of: synthesizing at least a 
video from the videophone — terminal line interface for 
non-deaf -mute persons and a video from the videophone 
terminal line interface for sign language interpreters and 
transmitting the resulting video to the videophone terminal 
line interface for deaf-mute persons; transmitting at least 
a video from the videophone — terminal line interface for 
deaf-mute persons and a voicc an audio from the videophone 
terminal line interface for sign language interpreters to the 
v - ideophone terminal line interface for non-deaf -mute persons-?— _^ 
and transmitting at least a video from the videophone 
terminal line interface for deaf-mute persons and a voice an 

audio from the videophone terminal line interface for 

non -deaf-mute persons to the videophone terminal line 

interface for sign language interpreters. In addition, the 
method is equipped with a sign language interpreter 
registration table where the terminal number of a sign language 
interpreter is registered, and the method including steps of: 
accepting a call to the line interface for deaf-mute persons 
or the line interface for non-deaf -mute persons and connecting 
the calling terminal, prompting the calling terminal to enter 
the terminal number of the called terminal, extracting the 
terminal number of a sign language interpreter from the sign 
language interpreter registration table, calling and 
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connecting the sign language interpreter terminal by using the 
extracted terminal number of the sign language interpreter from 
the line interface for sign language interpreters^ and calling 
and connecting the called terminal by using the acquired called 
terminal number, from the line interface for the non-deaf -mute 
person terminal in case the calling terminal is connected to 
the line interface for deaf-mute persons, or from the line 
interface for the deaf-mute person terminal in case the calling 
terminal is connected to the line interface for non-deaf -mute 
persons , 

With this configuration, upon a call from a terminal for 
deaf-mute persons or a terminal for non-deaf -mute persons, the 
target terminal and the terminal for sign language interpreters 
are automatically connected and a video and a voice required 
for sign language interpretation are transmitted, thereby a 
conversation over a videophone via sign language 
interpretation can be provided without the deaf-mute person, 
non-deaf -mute person and sign language interpreter holding 
prior consultation. 

Ao Q Gtcp to extract and call the terminal number of a 

oign — language — intGrprotcr — rcgiGtcrcd — arft — a — sign — language 
intorprctcr registration table is comprised, a sign language 
interpreter can prcsont sign language interpretation anyvjhorc 
he/she may be, — as — long — as hc/sho — can be — called, — thereby — a 
flexible and efficient sign language interpretation system can 
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be provided, — 

The abovo object, — othor objccta, — oharQctcristicD and 

Qdvantagco of the invention will be apparent from the follov^^ing 
detailed description of the embodimontG of the invention > — 

Brief Deocription of the Drawings 

The above elements , steps, features, characteristics and 

advantages of the present invention will be apparent from the 
following detailed description of preferred embodiments 
thereof with reference to the attached drawings, 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a system block diagram of a sign language 
interpretation system according to -st na preferred embodiment 
of the present i nvention; 

Fig. 2 shows an example of a video displayed on each screen 
of a terminal for deaf-mute persons, a terminal for 
non-deaf -mute persons, or a terminal for sign language 
interpreters of a sign language interpretation system 
according to a preferred embodiment of the present invention; 

Fig. 3 is a processing flowchart of a controller in a 
sign language interpretation system according to a fta preferred 
embodiment of the present i nve ntion; 

Fig. 4 shows an example of a sign language interpreter 
registration table; 
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Fig. 5 shows an example of a screen for prompting input 
of a called terminal number— j_ 

Fig. 6 shows an example of a screen for prompting input 
of sign language interpreter selecting conditions; 

Fig. 7 shows an example of a screen for displaying a list 
of sign language interpreter candidates; 

Fig. 8 is a system block diagram of a sign language 
interpretation system according to another preferred 
embodiment of the present i nve ntion; 

Fig. 9 shows an example of a connection table; and 

Fig. 1 0 is a processing flowchart of a controller in a 
sign language interpretation system according to another 
preferred embodiment of the pr esent invention. 

Best Mode for Carrying Out tho Invention 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
Fig. 1 is a system block diagram of a sign language 
interpretation system according to e^ a preferred embodiment 
of the present invention. This preferred embodiment shows a 
system configuration example aoouming that in which a terminal 
used by a deaf-mute person, a non-deaf -mute person or a sign 
language interpreter is a telephone- type videophone terminal 
connected to a public telephone line. 

In Fig. 1, er-numeral 100 represents a sign language 



18 



interpretation system installed in a sign language 
interpretation center which provides a sign language 
interpretation service. The sign language interpretation 
system 100 interconnects a videophone terminal for deaf-mute 
persons used by a deaf-mute person (hereinafter referred to 
as a deaf-mute person terminal) 300, a videophone terminal for 
non-deaf -mute persons used by a non-deaf -mute person 
(hereinafter referred to as a non-deaf -mute person terminal) 
310 through a public telephone line 200, and a videophone 
terminal for sign language interpreters used by a sign language 
interpreter (hereinafter referred to as a sign language 
interpreter terminal) 320 in order to provides- a videophone 
conversation service between a deaf-mute person and a 
non-deaf -mute person via sign language interpretation. 

The deaf-mute person terminal 300, non-deaf -mute person 
terminal 310 and sign language interpreter terminal 320 
respectively compri so include television cameras 300a, 310a, 
320a for imaging each user, display screens 300b, 310b, 320b 
for displaying the received video, and dial pads 300c, 310c, 
320c for input of inputting a telephone number or information. 
The non-deaf -mute person terminal 310 and sign language 

interpreter terminal 320 roopoctivoly compri Gc include 

headsets 31 Od, 320d which provides the user with input/output 
of voice. While input/output of voice is made using a handset 
on a typical telephone- type terminal, a headset is used instead 
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in order to keep free both hands of the user whose major concern 
is sign language. In the following description, a terminal 
uses a headset fixed that is worn on the head of the user 
including a non-deaf -mute person. While a headset is not shown 
on the deaf-mute person terminal 300, a headset may be used 
and voice communications may be used as well, in case a helper 
is there. 

Such a videophone terminal connected to a public line 
may be an ISDN videophone terminal based on ITU-T 
recommendation H.320 . However , the invention is not limited 
thereto and may use a videophone terminal which cmployG uses 
a unique protocol. 

The public telephone line may be of a wireless type. The 
videophone terminal may be a cellular phone or a portable 
terminal equipped with a videophone function. 

The sign language interpretation system 100 
GompriGQ 3 includes a line interface for the deaf-mute person 
terminal to connect to a deaf-mute person terminal (hereinafter 
referred to as an I/F) 120, a line I/F for the non-deaf -mute 
person terminal 140 to connect to a non-deaf -mute person 
terminal, and a line I/F for the sign language interpreter 
terminal 160 to connect to a sign language interpreter terminal. 
To each I/F are connected a multiplexer/demultiplexer 1 22, 1 42, 
162 for multiplexing/demultiplexing a video signal, an audio 
signal or a data signal, a video CODEC (coder/decoder) 124, 
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144, 164 for compressing/expanding a video signal , and an audio 
CODEC 1 26, 146, 166 for compressing/expanding an audio signal. 
Each line I/F, each multiplexer/demultiplexer, and each video 
CODEC or each audio CODEC perform call control, streaming 
control compression/expansion of a video/audio signal in 
accordance with a protocol used by each terminal. 

To the video input of the video CODEC 1 24 for the deaf-mute 
person terminal 124 is connected a video synthesizer 128 for 
synthesizing the video output of the video CODEC for the 
non-deaf -mute person terminal 144, the video output of the 
video CODEC for the sign language interpreter terminal 164 and 
the output of the telop memory for the deaf-mute person terminal 
132. 

To the audio input of the audio CODEC for the deaf-mute 
person terminal 126 is connected an audio synthesizer 130 for 
synthesizing the audio output of the audio CODEC for the 
non-deaf -mute person terminal 146 and the audio output of the 
audio CODEC for the sign language interpreter terminal 166. 

While audio input/output is generally not made provided 
on a deaf-mute person terminal in gcncrQl, — s^ , such that the 
audio CODEC 126 or the audio synthesizer 130 for the deaf-mute 
person terminal may be omitted, a voice communications function 
is preferably provided for a cggo situation where the 
environment sound of a deaf-mute person terminal is to be 
transmitted to a non-deaf -mute person terminal or a 
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CQOc situation where a helper assists the deaf-mute person. 

To the video input of the video CODEC for the 
non-deaf-mute person terminal 144 is connected a video 
synthesizer 1 48 for synthesizing the video output of the video 
CODEC for the deaf-mute person terminal 124, the video output 
of the video CODEC for the sign language interpreter terminal 
164 and the output of the telop memory for the non-deaf -mute 
person terminal 152. 

To the audio input of the audio CODEC for the 
non-deaf -mute person terminal 146 is connected an audio 
synthesizer 1 50 for synthesizing the audio output of the audio 
CODEC for the deaf-mute person terminal 1 25 and the audio output 
of the audio CODEC for the sign language interpreter terminal 
166. 

While video display of a sign language interpreter may 
be omitted on a non-deaf -mute person terminal, understanding 
of the voice interpreted by the sign language interpreter is 
made easy by displaying the video of the sign language 
interpreter, so that a function is preferably provided to 
synthesize the video of a sign language interpreter. 

To the video input of the video CODEC for the sign language 
interpreter terminal 164 is connected a video synthesizer 168 
for synthesizing the video output of the video CODEC for the 
deaf-mute person terminal 124, the video output of the video 
CODEC for the non-deaf -mute person terminal 144 and the output 



22 



of the telop memory for the sign language interpreter terminal 
172. 

To the audio input of the audio CODEC for the sign language 
interpreter terminal 166 is connected an audio synthesizer 170 
for synthesizing the audio output of the audio CODEC for the 
deaf-mute person terminal 126 and the audio output of the audio 
CODEC for the non- deaf -mute person terminal 146. 

While video display of a non-deaf -mute person may be 
omitted on a sign language interpreter terminal, understanding 
of the voice in interpreting the voice of a non-deaf -mute person 
is made — CQGy facilitated by displaying the video of the 
non-deaf -mute person, g ^such that a function is preferably 
provided to synthesize the video of a non-deaf -mute person. 

The sign language interpretation system 100 is equipped 
with a sign language interpreter registration table 182 where 
the terminal number of a terminal for sign language 
interpreters used by a sign language interpreter is registered 
and includes a controller 180 connected to each of the line 
I/Fs 1 20, 140, 1 60 , multiplexers/demultiplexers 1 22, 144, 1 62, 
video synthesizers 1 28, 148, 1 68, audio synthesizers 1 30 , 1 50, 
170, and telop memories 132, 152, 172. The controller 180 
provides a function to connect a calling terminal, a sign 
language interpreter terminal and a called terminal by way of 
a function to accept a call from a deaf-mute person terminal 
or a non-deaf -mute person terminal, a function to prompt a 
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calling terminal to enter the called terminal number, a 
function to extract the terminal number of a sign language 
interpreter from the sign language interpreter registration 
table 182, a function to call the extracted terminal number, 
and a function to call the terminal number of the called 
terminal, and also provides a function to switch a video/audio 
synthesis method used by video/audio synthesizers and a 
function to generate a telop and transmit the telop to a telop 
memory. 

Fig. 2 shows an example of a video displayed on the screen 
of each terminal during a videophone conversation by way of 
the sign language interpretation system according to the 
invention. Fig. 2(a) shows the screen of a deaf-mute person 
terminal. A video synthesizer 128 displays on the screen a 
video obtained by synthesizing a video of a non-deaf -mute 
person terminal and a video of a sign language interpreter 
terminal. While the video of the non-deaf -mute person is 
displayed as a main window and the video of the sign language 
interpreter is displayed as a sub window in a 
Picture-in-Picture fashion, a Pic ture-in-Picture display is 
also possible assuming the video of the sign language 
interpreter as a main window and the video of the non-deaf -mute 
person as a sub window. Or, these videos may be displayed in 
equal size. When the video of a sign language interpreter is 
displayed in a larger size, the sign language interpreted by 
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the sign language interpreter is easier to understand. A 
command from a terminal is preferably used to change the 
position of a sub window in the Picture- in-Picture display so 
that the sub window will not mask important information in the 
main window. 

Fig. 2(b) shows the screen of a non-deaf -mute person 
terminal. The video synthesizer 148 displays on the screen 
a video obtained by synthesizing a video of a deaf-mute person 
terminal and a video of a sign language interpreter terminal. 
While the video of the deaf-mute person is displayed as a main 
window and the video of the sign language interpreter is 
displayed as a sub window in a Picture- in-Picture fashion, only 
the video of the deaf-mute person may be displayed and the video 
of the sign language interpreter may be omitted. By displaying 
the video of the sign language interpreter in a sub window, 
the voice interpreted by the sign language interpreter becomes 
easier to understand. 

Fig. 2(c) shows the screen of a sign language interpreter 
terminal. The video synthesizer 168 displays on the screen 
a video obtained by synthesizing a video of a deaf-mute person 
terminal and a video of a non-deaf -mute person terminal . While 
the video of the deaf-mute person is displayed as a main window 
and the video of the non-deaf -mute person is displayed as a 
sub window in a Picture- in-Picture fashion, only the video of 
the deaf-mute person may be displayed and the video of the 
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non-deaf -mute person may be omitted. By displaying the video 
of the non-deaf -mute person in a sub window, the voice of the 
non-deaf -mute person interpreted by the sign language 
interpreter bccomco i s easier to understand. 

In order to support a oaso whcrc sit uat ion in which the 
environment sound of a deaf-mute person terminal is to be 
transmitted or a ccldo v^hcro situation in which a helper assists 
the deaf-mute person, a voice obtained by synthesizing the 
voice from the non-deaf -mute person terminal and the voice from 
the sign language interpreter terminal by using the audio 
synthesizer 130 is output to the deaf-mute person terminal, 
a voice obtained by synthesizing the voice from the deaf-mute 
person terminal and the voice from the sign language 
interpreter terminal by using the audio synthesizer 1 50 is 
output to the non-deaf -mute person terminal and a voice 
obtained by synthesizing the voice from the non-deaf -mute 
person terminal and the voice from the deaf-mute person 
terminal by using the audio synthesizer 170 is output to the 
sign language interpreter terminal. 

In CQ3Q When it is not necessary to transmit the 

environment e nvironmental sound of the deaf-mute person 
terminal or a helper is not present, the audio synthesizers 
1 30, 1 50 and 170 may be omitted_^ and the output of the audio 
CODEC for the non-deaf -mute person terminal 146 may be 
connected to the input of the audio CODEC for the sign language 



26 



interpreter terminal 166 and the output of the audio CODEC for 
the sign language interpreter terminal 166 may be connected 
to the input of the audio CODEC for the non-deaf -mute person 
terminal 1 46 . 

Operation of the video synthesizers 128, 148, 168 and 
audio synthesizers 1 30, 1 50, 1 70 is controlled by the 
controller 180. The user may change the video output method 
or audio output method by pressing a predetermined number 
button of a dial pad of each terminal. This is implement cd done 
when a puoh on press of the number button on the dial pad of 
each terminal is detected as a data signal or a tone signal 
by the multiplexer/demultiplexer 1 22, 144, 1 62 and detection 
of the push on press of the button is signaled to the controller. 

With this configuration, flexibility in the usage of the 
system on each terminal is ensured. For example, only 
necessary videos or audios are selected and displayed/output 
in accordance with the object^ or it is possible to replace 
a main window with a sub window, or change the position of the 
sub window. 

To the input of the audio synthesizers 1 28, 148, 168 are 
respectively connected a telop memory for the deaf-mute person 
terminal 132, a telop memory for the non-deaf-mute person 
terminal 152, and a telop memory for the sign language 
interpreter terminal 172. Contents of each telop memory 132, 
152, 172 can bca re set from the controller 180. 
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With this configuration, by setting a message to be 
displayed on each terminal to the telop memories 1 32, 1 52, 1 72 
and issuing an instruction to select a signal of the telop 
memories 1 32, 1 52, 1 72 to the audio synthesizers 1 28, 148, 1 68 
in the setup of a videophone conversation via sign language 
interpretation, it is possible to transmit necessary messages 
to respective terminals to establish a three-way call. 

In caoo When there is a term which that is hard di f f icul t 
to explain using sign language or a word v/hich that is 
hard dif f icult to pronounce in a videophone conversation, it 
is possible to register in advance the term in advance in the 
term registration table 184 of the controller 180 in 
association with the number of the dial pad on each terminal. 
By doing so, it is possible to detect a push on the dial pad 
on each terminal during a videophone conversation, extract the 
term corresponding to the number of the dial pad pressed from 
the term registration table, generate a text telop, and set 
the text telop to each telop memory, thereby displaying the 
term on each terminal. 

With this configuration, a term which is hard d if f icult 
to explain using sign language or a word which is hard dif f icult 
to pronounce is transmitted by way of a text telop— to the 
opponent party, thus^ providing a quicker and more to-the-point 
videophone conversation . 

Next , a processing flow of the controller 1 80 for setting 
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up a videophone conversation via sign language interpretation 
is shown. 

Prior to processing, information to select a sign 
language interpreter and the terminal number of a terminal used 
by each sign language interpreter are registered in the sign 
language interpreter registration table 182 of the controller 
180 from an appropriate terminal (not shown). Fig. 4 shows 
an example of a registration item to be registered in the sign 
language interpreter registration table 182. The information 
to select a sign language interpreter refers to information 
used by the user to select a desired sign language interpreter, 
which includes a— sex, aft— age, a— habitation, a-specialty, and 
the level of sign language interpretation. The habitation 
assumes a cqgg v^hcrQ situation in which the user desires a 
person who has geographic knowledge on a specific area and, 
in this example, a ZIP code is used to specify an area. The 
specialty assumes a cqgg vi^hGrc situation in which , in case the 
conversation pertains to a specific field, the user desires 
a person who has expert knowledge eftof the field or is familiar 
with the topics in the field. In this example, the fields a 
sign language interpreter is familiar with are classified into 
several categories to be registered, such as politics, law, 
business, education, science and technology, medical care, 
language, sports, and hobby. The specialties are diverse, 
se such that they may be registered hierarchically and searched 
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through at a level desired by the user when selected. 

In addition, qualifications of each sign language 
interpreter may be registered in advance for the user to select 
a qualified person as a sign language interpreter. 

The terminal number to be registered is the telephone 
number of the terminal, because in this example a videophone 
terminal to connoct connected to a public telephone line is 
asGumod . p rovided . 

In the sign language interpreter registration table 182 
is provided , an availability flag is provided to indicate 
whether sign language interpretation can be accepted. A 
registered sign language interpreter can call the sign language 
interpretation center from his/her terminal and enter a command 
by using a dial pad to set/reset the availability flag. Thus, 
a sign language interpreter registered in the sign language 
interpreter registration table can set the availability flag 
only when he/she is available for sign language interpretation, 
thereby eliminating useless calling and allowing the user to 
select an available sign language interpreter without delay. 

Fig. 3 shows a processing flowchart of the controller 
180. The sign language interpretation system 100 allows a 
deaf-mute person terminal or non-deaf -mute person terminal to 
propose a sign language interpretation service. From the 
deaf-mute person terminal, the user places a call to a telephone 
number on the line I/F for the deaf-mute person terminal. From 
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the non-deaf -mute person terminal, the user places a call to 
a telephone number on the line I/F for the non-deaf -mute person 
terminal. This calls the sign language interpreter terminal 
and the opponent terminal and establishes a videophone 
connection via sign language interpretation. 

As shown in Fig. 3, it is first detected that the line 
I/F for the deaf-mute person terminal 120 or line I/F for the 
non-deaf -mute person terminal 140 is called (SI 00) . Next, the 
calling terminal displays a screen to prompt input of the 
terminal number of the called party shown in Fig. 5 (S102). 
The terminal number of the called party input by the caller 
is acquired (SI 04). The calling terminal displays a screen 
to prompt input of the selection conditions for a sign language 
interpreter shown in Fig. 6 (SI 06). The sign language 
interpreter selection conditions input by the caller are 
acquired (SI 08). The sign language interpreter selection 
conditions input by the caller are sex, age bracket, area, 
specialty and sign language level, A corresponding sign 
language interpreter is selected based on the sex, age, 
habitation, specialty, and sign language level registered in 
the sign language interpreter registration table 182. The 
area is specified by using a ZIP code and a sign language 
interpreter is selected starting with the habitation closest 
to the specified area. For any selections, in case it is not 
necessary to specify a condition, N/A may be selected. 
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Next, a sign language interpreter with an availability 
flag set is selected from among the sign language interpreters 
satisfying the selection conditions acquired referring to the 
sign language interpreter registration table 1 82 . The calling 
terminal displays a list of sign language interpreter 
candidates shown in Fig. 7 to prompt input of the selection 
number of a desired sign language interpreter (SI 10). The 
selection number of the sign language interpreter input by the 
caller is acquired (S112) and the terminal number of the 
selected sign language interpreter is extracted from the sign 
language interpreter registration table 182 and the terminal 
is called (SI 14) . When the sign language interpreter terminal 
has accepted the call (SI 16), the called terminal number is 
extracted and called (SI 18). When the called terminal has 
accepted the call (S120), a videophone conversation via sign 
language interpretation starts (SI 22) . 

In case the sign language interpreter terminal selected 
in SI 66 does not accept the call, whether a next candidate is 
available is determined (SI 24). In case a next candidate is 
available, execution returns to SI 1 4 and the procedure is 
repeated. Otherwise^ the calling terminal is notified as such 
and the call is released (S126). 

In case the called terminal does not accept the call in 
S120, the calling terminal and the selected sign language 
interpreter terminal are notified as such and the call is 
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released (SI 28) . 

While in lf case the selected sign language interpreter 
terminal does not accept the call, the caller is notified as 
such and the call is released in the above preferred embodiment , 
a sign language interpretation reservation table to register 
a calling terminal number and a called terminal number may be 
provided^ and the caller and the called party may be notified 
on a later response from the selected sign language interpreter 
to set a videophone conversation. 

While the sign language interpretation system 100 

compr i GO o p refer ably includes a line I/F, a 

multiplexer/demultiplexer, a video CODEC, an audio CODEC, a 
video synthesizer, an audio synthesizer and a controller in 
the above preferred embodiment, these components need not be 
implcmontcd — provided by individual hardware (H/W-) — . 
Instead, the function of each component may be implomontod 
provided based on software running on a computer. 

While the sign language interpreter terminal 320, oamc 
^ — similar to the deaf-mute person terminal 300 and the 
non-deaf -mute person terminal 310, is located outside the sign 
language interpretation center and called from the sign 
language interpretation center over a public telephone line 
to provide a sign language interpretation service in the above 
preferred embodiment, the invention is not limited thereto but 
part . Part or all of the sign language interpreters may be 
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provided in the sign language interpretation center to provide 
a sign language interpretation service from the sign language 
interpretation center . 

In the above -described preferred embodiment , a sign 
language interpreter can join a sign language interpretation 
service anywhere he/she may be, as long as he/she has a terminal 
which can be connected to a public telephone line. Thus^ the 
sign language interpreter can provide a sign language 
interpretation service by using the availability flag to make 
efficient use of free time. By doing so, it is possible to 
stably operate a sign language interpretation service 
acGompanicd by a even with the p roblem of difficult reservation 
of a sign language interpreter. In particular, the number of 
volunteer sign language interpreters is increasing 



irregularly can provide a sign language interpretation service 
by taking advantage of a— limited free time. 

While a video signal of the home terminal is not input 
to the video synthesizers 128, 148, 1 68 in the above preferred 
embodiment, a function may be provided to input the video signal 
of the home terminal for later synthesis and display to check 
the video on the terminal. 

While the video synthesizers 1 28, 148, 168 and the audio 
synthesizers 130, 150 170 are used to synthesize videos and 
audios for each terminal in the above preferred embodiment , 
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videos and audios from all terminals may be synthesized at 
eoee the same time^ and the resulting video or audio may be 
transmitted to each terminal. 

While a function is provided whereby the telop memories 
1 32, 1 52, 172 are provided and telops are added to the video 
synthesizers 128, 148, 168 in order to display a text telop 
on each terminal in the above preferred embodiment, a function 
may be provided whereby a telop memory to store audio 
information and telops are added to the audio synthesizers 130, 
1 50, 1 70 in order to output an audio message on each terminal. 
This makes it possible to set a videophone conversation via 

sign language interpretation even caoQ w hen the 

non-deaf -mute person is a visually impaired person. 

Fig. 8 is a system block diagram of a sign language 
interpretation system according to another preferred 
embodiment of the invention. This preferred embodiment shows 
a system configuration example assuming — that in which each 
terminal used by a deaf-mute person, a non-deaf -mute person 
and a sign language interpreter is aan IP (Internet Protocol) 
type videophone terminal to connect to the internet equipped 
with a web browser. 

In Fig. 8, a numeral 400 represents a sign language 
interpretation system installed in a sign language 
interpretation center to provide a sign language 
interpretation service. The sign language interpretation 
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system 400 connects a deaf-mute person terminal 600 used by 
a deaf-mute person, a non-deaf -mute person terminal 700 used 
by a non-deaf -mute person, and any of the sign language 
interpreter terminals used by a sign language interpreter 431 , 
432, ... via the Internet 500 in order to provide a videophone 
conversation service via sign language interpretation between 
the deaf-mute person and the n on-deaf -mute person. 

While the deaf-mute person terminal 600, the 
non-deaf -mute person terminal 700 and the sign language 
interpreter terminals 431, 432,... each compriGGs includes a 
general-purpose processing device (a) such as a personal 
computer having a video input I/F function, an audio 
input/output I/F function and a network connection function, 
the processing device equipped with a keyboard (b) and a mouse 
(C) for input of information as well as a display (d) for 
displaying a web page screen presented by a web server 410 and 
a videophone screen supplied by a communications server 420, 
a television camera (e) for imaging the sign language of a sign 
language interpreter, and a headset (f) for performing audio 
input/output for the sign language interpreter, the processing 
device has IP videophone software and a web browser installed 
in this example, a dedicated videophone terminal may be used 
instead. 

The videophone terminal connected to the Internet may 
be an IP videophone terminal based on ITU-T recommendation 
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H,3 23 > However , the present invention is not limited thereto 
but , and may use a videophone terminal which cmployo h as a 
unique protocol. 

The Internet may be of a wireless LAN type. The 
videophone terminal may be a cellular phone or a portable 
terminal equipped with a videophone function and also including 
a web access function. 

The sign language interpretation system 400 
compriGGG : include s a communications server 420 including a 
connection table 422 for setting the terminal addresses of a 
deaf-mute person terminal, a non-deaf-mute person terminal and 
a sign language interpreter terminal go well go , and a function 
to interconnect the terminals registered in the connection 
table 422 and synthesize a video and an audio received from 
each terminal^ and transmit the synthesized video and audio 
to each terminal-r_f_ a web server 410 including a sign language 
interpreter registration table 412 for registering the 
selection information, terminal address and availability flag 
of a sign language interpreter as mentioned carlior, — ao v i ^cll 
es — described above, and a function to select a desired sign 
language interpreter based on an access from a calling terminal 
fey— using a web browser and set the terminal address of each 
of the calling terminal, called terminal and sign language 
interpreter terminal in the connection table 422 of the 
communication server 420-rj_ a router 450 for connecting the web 
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server 410 and the communications server 420 to the Internet-rj_ 
and a plurality of sign language interpreter terminals 431 , 
432,..., 43N connected to the communications server 420 via a 
network. 

Fig. 9 shows an example of a connection table 422. As 
shown in Fig. 9, the terminal address of a deaf-mute person 
terminal, the terminal address of a non-deaf -mute person 
terminal and the terminal address of a sign language 
interpreter terminal are registered as a set in the connection 
table 422. This provides a single sign language 

interpretation service. The connection table 422 is designed 
to register a plurality of such terminal address set depending 
on the throughput of the communications server 420, thereby 
simultaneously providing a plurality of sign language 
interpretation service s . 

While the terminal address registered in the connection 
table 422 is an address on the Internet and is generally an 
IP address, the present invention is not limited thereto but 
#eie . For example a name given by a directory server may be 
used. 

The communications server 420 performs packet 
communications using a predetermined protocol with the 
deaf-mute person terminal, non-deaf -mute person terminal and 
sign language interpreter terminal set to the connection table 
422 and provides, by way of software processing, the functions 
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similar to those provided by a multiplexer /demultiplexer 1 22, 
142, 1 62, a video CODEC 1 24, 144, 164, an audio CODEC 1 26 , 146, 
166, a video synthesizer 128, 148, 168, an audio synthesizer 
1 30, 1 50, 1 70 in the above -described sign language 
interpretation system 100. 

With this configuration, same qo similar to the sign 
language interpretation system 100, prcocribcd p redetermined 
videos and audios are communicated between a deaf-mute person 
terminal, a non-deaf -mute person terminal and a sign language 
interpreter terminal, and a videophone conversation via sign 
language interpretation is established between the deaf-mute 
person and the non- deaf -mute person. 

While the sign language interpretation system 100 
preferably uses the controller 180 and the telop memories 132, 
1 52, 172 to extract a term registered in the term registration 
table 184 during a videophone conversation based on eft 
ino true tion inst ructions from a terminal and displays the term 
as a telop on the terminal, the same function may be provided 
by way of via software processing by the communications server 
420 in this preferred embodiment aloo . A term specified by 
each terminal may be displayed as a popup message on the other 
terminal by way of via the web server 410. Or, a telop memory 
may be provided in the communications server 420 ge- such that 
a term specified by each terminal will be written into the telop 
memory via the web server 410 and displayed as a text telop 
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on each terminal. 

While the sign language interpretation system 100 uses 
the controller 1 80 to interconnect a deaf-mute person terminal , 
a non-deaf -mute person terminal and a sign language interpreter 
terminal, the connection procedure is made by the web server 
410 in this preferred embodiment because each terminal has a 
web access function. 

Fig. 1 0 is a processing flowchart of a connection 
procedure by the web server 410. The sign language 
interpretation system 400 also allows permits a deaf-mute 
person terminal or non-deaf-mute person terminal to 
proposo request a sign language interpretation service. A 
deaf-mute person or a non-deaf -mute person wishing to 
proposo request a sign language interpretation service 
accesses the web server 41 0 in the sign language interpretation 
center fey-using a web browser to log in from each own terminal , 
which starts the acceptance of the sign language interpretation 
service . 

As shown in Fig. 10, the web server 410 first acquires 
the terminal address of a caller (S200) and sets the terminal 
address to the connection table 422 (S202) . Next, the web 
server delivers a screen to prompt input of the called terminal 
address_^ similar to that shown in Fig. to the calling 

terminal (S204) . The called terminal address input by the 
caller is acquired (S206) . The web server delivers a screen 
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to prompt input of the selection conditions for a sign language 
interpreter^ similar to that shown in Fig. 6_j_ to the calling 
terminal (S208) . The sign language interpreter selection 
conditions input by the caller are acquired (S210). 

Next, a sign language interpreter with availability flag 
set is selected from among the sign language interpreters 
satisfying the selection conditions acquired from the sign 
language interpreter registration table 412. The web server 
410 delivers a list of sign language interpreter candidates 
similar to that shown in Fig. 7 to the calling terminal to prompt 
input of the selection number of a desired sign language 
interpreter (S212) . The selection number of the sign language 
interpreter input by the caller is acquired and the terminal 
address of the selected sign language interpreter is acquired 
from the sign language interpreter registration table 412 
(S214)- Based on the acquired terminal address of the sign 
language interpreter, the web server 410 delivers a calling 
screen to the sign language interpreter terminal (S216). ^ 
casG lf the call is accepted by the sign language interpreter 
(S218) , the terminal address of the sign language interpreter 
is set to the connection table 422 (S220) . Next, the web server 
410 delvers a calling screen to the called terminal based on 
the acquired called terminal address (S222) . In caoG lf the 
call is accepted by the called terminal (S224), the called 
terminal address is set to the connection table 422 (S226) . 
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Then, a videophone conversation via sign language 
interpretation starts (S228) . 

In GQGQ if the sign language interpreter terminal does 
not accept the call in S218, whether a next candidate is 
available is determined (S230) . In cQsc If a next candidate 
is available, the web server delivers a message to prompt the 
caller to select another candidate (S232) to the calling 
terminal, then execution returns to S214. In caoo lf another 
candidate is not found, the calling terminal is notified stB 
ouch (S234) and the call is released. 

In cQGC lf the called terminal does not accept the call 
in S224, the calling terminal and the selected sign language 
interpreter terminal are notified as ouch (S236) and the call 
is released. 

While in cqgg When the selected sign language 

interpreter terminal does not accept the call, the caller is 
notified ao ouch and the call is released in the above preferred 
embodiment, a sign language interpretation reservation table 
to register a calling terminal address and a called terminal 
address may be provided and the caller and the called party 
may be notified on a later response from the selected sign 
language interpreter to set a videophone conversation. 

While the sign language interpreter terminal is located 
in the sign language interpretation system 400 of the sign 
language interpretation center in the above preferred 
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embodiment, the present invention is not limited thereto but 
Gomo . Some or all of the sign language interpreter terminals 
may be provided outside the sign language interpretation center 
and connected via the Internet . 

In the above preferred embodiment, the configuration of 
the sign language interpretation system has been described ^^^=- 
a caGQ where a videophone terminal used by a deaf-mute person, 
a non-deaf-mute person or a sign language interpreter is a 
telephone- type videophone terminal connected to a public 
telephone linej_ and q cqgg where the videophone terminal is 
an IP-type videophone terminal connected to the Internet, the 
telephone- type videophone terminal and the IP- type videophone 
terminal can communicate with each other by arranging a gateway 
to perform protocol conversion therebetween. A sign language 
interpretation system conforming to one protocol may be 
provided via the gateway to support a videophone terminal 
conforming to the other protocol. 

In this way, the sign language interpretation system 
allowG enables the user to enjoy or provide a sign language 
interpretation service anywhere he/she may be, as long as 
he/she has a terminal which can be connected to a public 
telephone line or the Internet. A sign language interpreter 
does not always have to visit a sign language interpretation 
center but can present a sign language interpretation from 
his/her home or a facility or site where a videophone terminal 
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is located, or provide a sign language interpretation service 
by using a cellular phone or a portable terminal equipped with 
a videophone function. 

A person with — thB — ability — &# having sign language 
interpretation abilities may wish w ant to register in the sign 
language interpreter registration table in the sign language 
interpretation center in order to provide a sign language 
interpretation service anytime when it is convenient to him/her 
From the viewpoint of the operation of the sign language 
interpretation center, it is not necessary to summon for the 
sign language interpreters to go to the center. This 
allows enables efficient operation of the sign language 
interpretation center both in terms of time and costs. In 
particular, the number of volunteer sign language interpreters 
is increasing nov/adaya . p rese nt ly . The sign language 
interpretation service can be provided from a sign language 
interpreter's home, which facilitates reservation of a sign 
language interpreter. 

Industrial Applicabili ty 

As mentioned above, according to the sign language 
interpretation system or sign language interpretation method 
of the invention, it is not necessary for a deaf-mute person, 
a non-deaf -mute person and a sign language interpreter to hold 
prior consultation to reserve an MCU, which satisfies an urgent 
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need. 



While the present invention has been described with 



respect to preferred embodiments 


thereof, it will be apparent 


to those skilled in the art that 


the disclosed invention may 


be modified in numerous ways and 


may assume many embodiments 


other than those specifically set out and described above. 


Accordingly, it is intended by the 


appended claims to cover all 


modifications of the invention 


which fall within the true 



spirit and scope of the invention. 
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